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Introduction 


With the increased focus on issues 
of diversity and multiculturalism in the 
United States and abroad, educators and 
clinicians have become more and more 
concerned about the feasibility and valid- 
ity of their assessment instruments and 
practices for children and adults from 
non White backgrounds. Many researchers 
(e.g., Brown, Lipford-Sanders, & Shaw, 
1995; Sue & Sue; 2003) emphasize that 
when working with racially diverse groups 
in multiple settings, issues relating to their 
cultures often differ from those of the domi- 
nant group and thus warrant different 
approaches and considerations. Therefore, 
the need to foster a multicultural perspec- 
tive within educational and psychological 
assessment that embraces more than just 
test instruments is evident and paramount 
(D’Andrea, Daniels, & Heck, 1991; Ivey, 
Ivey, & Simek-Morgan, 1993; Johnson, 
Torres, Coleman, & Smith, 1995). 

For people of color, the negative and 
harmful effects of assessment practices 
reaches far beyond mere measurement and 
focuses on more critical issues than just 
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testing bias. For people of color, a cultural 
approach to assessment must begin with 
a dialogue on multicultural standards, 
competencies, guidelines, training, and 
with the relevant profession for which the 
education and assessment is intended. 

Thus, a multicultural approach neces- 
sitates a moral and ethical responsibility for 
higher education institutions to be propo- 
nents of diversity and to prepare culturally 
sensitive professional educators to work 
with the diverse groups in our society. 

As a result of this call to professions 
to embrace a sense of ethical and moral re- 
sponsibility to people of color, researchers 
from multiple disciplines in education have 
reiterated the importance of development 
of culturally appropriate and culturally 
sensitive assessment instruments as well 
as the development of ethical standards 
and training guidelines to prepare com- 
petent professionals who choose to work 
with culturally diverse people (e.g., Krish- 
namurthi, 2003; Lindsey, 2000; Suzuki, 
2001; Wall & Walz, 2003). 

The Impact of Assessment, 
Measurement, Testing, 
and Research 
on Marginalized People 

This need for a cultural approach 
in educational assessment also reaches 
beyond a mere awareness and knowledge 
of racial and ethnic differences to encom- 
pass broader areas such as assessment, 
practice, training, ethics, and research re- 
lated to working with people from diverse 



backgrounds, specifically people of color 
(Miller-Jones, 1989; Ridley, Hill, & Wiese, 
2001; Roysircar, Sandhu, & Bibbins, 2003; 
Suzuki, Ponterotto, & Meller, 2001; Va- 
lencia & Suzuki, 2001). A prime example 
is professionals acquiring competencies 
and culturally sensitive skills necessary 
to work with diverse groups in multiple 
settings, where issues relating to their 
race, ethnicity, and culture often differ 
from those of the dominant group, and thus 
may warrant different approaches and 
considerations than those of the dominant 
group (Roysircar et al., 2003). 

A cultural assessment approach must 
also include the appropriate and respon- 
sible use of the dissemination of research 
and measurement instruments, including 
their selection, administration, scoring, 
interpretation, and communication, as 
well as recognition of the preponderance 
of bias existing within the practice of the 
field of educational measurement and 
other disciplines within the academy. 

Therefore, a comprehensive under- 
standing of the importance of the role 
culture plays in educational assessment 
requires examining assessment in light of 
its importance to race, culture, ethnicity, 
gender, and other diversity variables. In 
addition, there needs to be input on the bias 
and the negative impact of assessment on 
people of color from multiple sources and 
from a variety of disciplines within educa- 
tion, such as counselor education, higher 
education, educational psychology, teacher 
education, special education, educational 
technology, and educational leadership. 


MULTICULTURAL EDUCATION 

I 1 


Cross-Cultural Assessment: 

A Phenomenon with Deep Pockets 

In an overview of cross-cultural 
assessment, we offer a simple, but com- 
prehensive explanation of various terms 
such as test, measurement, and assess- 
ment. This is a necessary prerequisite to 
a dialogue on multicultural assessment, 
as well as a starting point for a broader 
understanding of culture in assessment. 
According to Kaplan and Saccuzzi (1993), 
a test is a measurement tool that quanti- 
fies behavior, whereas measurement is the 
process by which things are differentiated 
(Hopkins & Stanley, 1990). In contrast, 
“assessment is used to evaluate an indi- 
vidual so that he or she can be described 
in terms of current functioning and also so 
that predictions can be made concerning 
future functioning” (Kaplan & Saccuzzi, 
p. 219). This means that tests are merely 
one method of assessment and one part of 
the assessment process. 

Unfortunately, in American society, for 
people of color the process of measurement 
has often been used to discriminate against 
groups. In fact, members of marginalized 
groups are often assessed unfairly when 
their behavior, feelings, thoughts, or ex- 
periences deviate from those of the Anglo- 
Saxon, heterosexual, able-bodied, middle- 
class, White male standard (Feagin, Vera, 
& Batur, 2001; Robinson, 2005; Scheurich, 
& Young, 1997). 

Historically, in different arenas of 
measurement and testing, culturally di- 
verse groups have been unfairly and dis- 
proportionately labeled as dysfunctional, 
abnormal, of low intelligence, mentally ill, 
or dangerous to society. Such discrimina- 
tion has been both costly and harmful to 
people of color and other marginalized 
groups, as well as to the well-being of 
society as a whole, and thus definitely 
warrants further consideration. 

Another important area to examine 
is the damage caused by biased instru- 
ments and racist ideologies, and how 
this prejudice has encouraged the misuse 
and abuse of the entire testing process 
(Sabatier, 2003; Scheurich & Young, 
1997; Wyche & Novich, 1986). The unfair 
treatment of marginalized groups due to 
biases toward individuals who are cultur- 
ally different and the resultant biases of 
the measurement instruments we employ, 
leaves us — as professionals — in a precari- 
ous ethical quandary. 

We know that if advancement is to 
be made in assessment, the research fo- 
cus must be on developing measurement 
instruments that will be free of bias and 
will assure fairness for all cultural groups. 
Concomitantly, there is a charge to those 


disciplines and individuals involved in test- 
ing, measurement, and assessment to not 
only develop unbiased instruments, but also 
instruments that can accurately measure 
multicultural awareness, skills, sensitivity, 
and competency of the individuals involved 
in and in charge of assessment. 

From the counseling and education lit- 
erature we know that a necessary requisite 
of multicultural assessment in counseling 
and therapy is self-assessment (Dana, 
2000; Ivey et al., 1993; Roysircar et al., 
2003; Sue, Arredondo, & McDavis, 1992). 
Self-awareness and self-assessment co-ex- 
ist and are not separate entities. According 
to Greeley, Garcia, Kessler, and Gilchrest, 
(1992), self-awareness starts with self-as- 
sessment, that is, knowledge of one’s racial 
or cultural identity development. 

A critical component of self-assessment 
is to acknowledge cultural differences and 
assess whether you as a practitioner feel 
comfortable discussing cultural, ethnic, or 
racial issues (Ivey et al., 1993; Sue & Sue, 
2003). Pope-Davis and Ottawi (1994) con- 
cur that contrary to the experiences of most 
people of color, White Americans are rarely 
called on to assess their own attitudes 
about their White ethnicity. Therefore, to 
correct this historic pattern, all individu- 
als involved in assessment should become 
self-aware, including an awareness of their 
own potential biases towards people from 
different cultures. 

According to Greeley and colleagues 
(1992), a starting place for this assess- 
ment is with instruments created to as- 
sess stages of racial identity development. 
There is a developing awareness that some 
measure of cultural identity is essential for 
most counseling situations (Brown et al., 
1995; Gainer, 1992; Harris, 2003). Rollock, 
Westman, and Johnson (1992) feel that 
White professionals who do not increase 
their cultural knowledge will have propen- 
sities toward over-pathologizing and thus 
undermining therapeutic effectiveness. 
Similarly, nonWhite professionals working 
with White clients in a counseling situa- 
tion who do not possess and understand 
their client’s cultural knowledge run the 
same risks of therapeutic ineffectiveness. 

A Call to Action 

A clear example of the continued 
disparate impact that educational mea- 
surement has exacted on people of color 
can be found in the work of Eeels, Davis, 
Havighurst, Herrick, and Tyler (1951) 
from over a half century ago. Although 
the educational reform and testing craze 
that we witness today didn’t start until 
the early 1980s, these earlier findings 


hold relevancy in the area of cross-cultural 
measurement. 

Eeels and colleagues found an ap- 
parent contradiction, that is, on the one 
hand, the instruments used to measure 
achievement and competence are being 
more urgently called for and more widely 
used than ever before whereas, on the 
other hand, tests are, at the same time, 
being more sharply criticized and strongly 
opposed. Unfortunately, this dilemma 
of balancing the validity of tests and 
minimizing bias and harm when assessing 
people of color is still relevant today. 

This criticism of and opposition to 
tests has been fueled largely by multi- 
cultural literature identifying the unfair 
and sometimes harmful effects of racist 
ideologies, biases, and biased instruments 
and procedures on marginalized groups, 
specifically people of color (Burley, Butner, 
Marbley, & Bush, 2001; Drew, 1973; Gay & 
Abrahams, 1973; Sabatier, 2003; Scheurich, 
& Young, 1997). In our study, this criticism 
is widened to include a discussion of biases 
that exist with researchers and assessors. 
Therefore, for real strides to be made in 
the field of educational assessment and 
measurement, we must employ an effec- 
tive, comprehensive approach that reaches 
beyond the areas of measurement and 
testing to encompass assessment, practice, 
training, and research (Miller-Jones, 1989; 
Roysircar et al., 2003; Suzuki, 2001). 

The aforementioned opposition to 
more testing can be attributed in part to 
the bias, misuse, and abuse of the measure- 
ment instruments used to evaluate people 
of color (Sedlacek, 1994; Miller-Jones, 
1989), but a great deal of the bias is inher- 
ent within the practice and the profession- 
als. Therefore, established multicultural 
competencies and standards must advance 
the notion that the principal goals for 
culturally skilled counselors and for other 
professionals are to become aware of their 
own assumptions about human behavior, 
to seek an understanding of their diverse 
clientele’s assumptions about human be- 
havior, and to become active in developing 
appropriate intervention strategies (Mar- 
bley, 2004; Roysircar et al., 2003; Sue et 
al., 1992; Toporek & Reza, 2001). 

In response to the urgent call for 
unbiased instruments as well as assess- 
ment procedures and instruments in 
the education and mental health fields 
that can adequately assess practitioners’ 
multicultural competencies, numerous 
articles and books were published within 
the mental health arena regarding mul- 
ticultural training, competencies, and 
guidelines (Ponterotto, Rieger, Barrett, & 
Sparks, 1994; Pope-Davis & Dings, 1994; 
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Roysircar et al., 2003; Sue, Arredondo, & 
McDavis, 1992). 

In addition, professional associations 
and state licensure boards in some fields 
have implemented multicultural standards 
that provide guidelines and a framework 
for practitioners to become culturally 
skilled and responsible. For example, the 
Association for Assessment in Counsel- 
ing and Education (AACE) Multicultural 
Assessment Standards stress the need to 
have assessment instruments that are fair 
and beneficial to members of all popula- 
tions. Similar responses have occurred in 
other disciplines, such as teacher educa- 
tion, educational psychology, and higher 
education. 

We believe that if a broader and more 
comprehensive understanding of multi- 
cultural assessment is to develop, it will 
take more than a call to the professions. 
As professionals ourselves, from different 
disciplines, we believe that a viable ap- 
proach is to “go grassroots,” that is, increase 
the dialogue with people of color within the 
relevant disciplines in order to get a better 
grasp of everyone’s view of the key diversity 
issues within the field of educational mea- 
surement and assessment that are found to 
negatively impact people of color. 

Therefore, the purpose of our study is 
to glean from professional people of color 
in the field of education their experiences 
and perceptions of contemporary assess- 
ment instruments and practices and the 
relative influence these practices exert on 
people of color. 

Theoretical Framework 

We used Sedlacek’s (1994) model to 
organize the understanding of the cross- 
cultural assessment literature, as well as 
to serve as a theoretical framework. In 
essence, this model is used to: (a) frame 
the fragmented body of multicultural as- 
sessment research literature into a compre- 
hensive body of information concerning the 
phenomenon of people of colors’ experiences 
with measurement, testing and assessment; 
(b) identify the critical issues affecting the 
field; and (c) attempt to explain why such 
vast numbers of people of color are “falling 
through the cracks,” that is, being adversely 
impacted by assessment. 

In the areas of measurement and 
assessment, Sedlacek (1994) identified 
five diversity issues plaguing the field 
of counseling: (a) what groups should 
be included, and what terms should be 
applied to those groups; (b) the develop- 
ment of a single instrument or measure 
that would be valid for all; (c) studies and 
research that are not designed for people 


of color; (d) the importance of missing or 
incomplete data and how the lack of that 
data may bias the sample and invalidate 
the instruments and the procedures; and 
(e) a shortage of well-trained professionals 
working in this area. 

Method 

The methodology we selected allowed 
us to pose and subsequently answer the 
following research questions: 

(1) What factors in assessment and 
measurement are influenced or im- 
pacted by multiculturalism? 

(2) What are the perceptions of profes- 
sional educators of people of color’s 
experiences in using assessment and 
testing services? This includes sub- 
questions of: (a) What key factors are 
involved in the assessment and testing 
experiences considered unsuccessful? 
and (b) What factors are involved in 
the assessment and testing experi- 
ences considered successful? 

(3) Through the lens of educators’ of 
color unique academic disciplines, 
what have they learned from train- 
ing, teaching, researching, and clini- 
cal and practical work with people of 
color in their perspective fields? Also, 
how can this collective data be honed 
in a manner that can be understood 
as both commonalities and disci- 
pline-specific competencies? Finally, 
how can this information foster and 
facilitate dialogue on diversity issues 
among disciplines and among colleges 
and universities? 

Participants 

The sample group for this study was 
purposefully selected using the maximum 
variation sampling strategy. According to 
Patton (2002), purposeful sampling aims at 
capturing and describing the main themes 
or major outcomes that cut across partici- 
pant variation. The 14 participants chosen 
were professional educators: (a) from 
multiple disciplines in higher education; 
(b) self-identified as members of one of the 
four major groups of color: African Ameri- 
can, Asian, Hispanic/Latino, and Native 
American Indian; and (c) had witnessed 
or experienced bias or biased instruments 
within the field of education. 

This small purposeful sample of 
gender and ethnically diverse individuals 
had two advantages: (1) it yielded detailed 
descriptions of high quality; and (2) it un- 
covered important shared patterns among 
peoples of color of their experiences with 


measurement, testing, and assessment 
emerging out of their heterogeneous cul- 
tural backgrounds. 

For this study, we utilized professional 
contacts and gathered information through 
various data banks: State Board of Educa- 
tion information, alumni groups, and pro- 
fessional higher education organizations. 
These contacts provided 21 possible par- 
ticipants. Sixteen out of the 21 individuals 
agreed to participate in the study. Of the 
14 selected who completed the study, there 
were six males and eight females and nine 
African Americans, one Hispanic/Latino, 
and two Native Americans. 

The disciplines represented included 
counselor education, law, adult education, 
vocational education, health education, 
elementary education, higher education, 
education administration, curriculum 
and instruction, and history. Nine were 
students (eight full-time) with extensive 
professional backgrounds and part time 
jobs (eight in doctoral programs). Seven 
participants were administrators, four in 
higher education institutions and three in 
public schools. There were two attorneys 
who both had professional ties to educa- 
tion. The participants’ level of education 
ranged from masters to postdoctorate. 

The females ranged in age from 32 
to 60, with a mean age of 36.5; the men 
ranged in age from 25 to 50, with a mean 
age of 42. In an effort to acknowledge the 
various cultural and ethnic differences 
existing within each group, participants 
were asked questions related to their level 
of acculturation and their ethnic and racial 
origin. Other demographic data gathered 
included educational backgrounds, profes- 
sional identity, specialty areas, certifica- 
tions, and employment status. 

Design and Procedure 

This study was conducted in three 
parts: (a) a standard open-ended interview; 
(b) informal conversational interviews; 
and (c) a focus on the participants’ roles 
as a professional and as a layperson. The 
study is a qualitative investigation using 
a phenomenological theoretical orientation 
focusing on the participants’ roles as both 
client and counselor. 

Qualitative data methods consisted 
of three kinds: (1) in-depth, open-ended 
interviews; (2) informal conversational and 
follow-up interviews; and (3) collection and 
examination of written documents. Accord- 
ing to Patton, (2002), the interviews pro- 
vided people the opportunity to respond in 
their own words and to express their own 
personal perspectives about their experi- 
ences, opinions, feelings, and knowledge. 

The standard open-ended interview 
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lasted approximately 90 minutes and was 
audio-recorded. Participants were asked 
to respond to each item as it related to 
their professional and personal experience 
as well as to their areas of study. After 
the taping, the participants were asked 
to review and critique their audiotaped 
interview and to review a transcript from 
a videotaped session. Some declined and 
preferred not to review the transcripts. 
Following the initial interviews, the first 
named author reviewed, critiqued, and 
transcribed the audiotape interviews. 

Participants were also asked to either 
provide or review any written documenta- 
tion regarding their experiences with as- 
sessment and measurement instruments 
(e.g., professional reports, standardized 
test scores, grades) and journal their 
reactions or comments to the materials. 
Lastly, participants were given a diskette 
and instructed to maintain a journal of 
their comments, feelings, or reactions to 
any parts of this study. 

Data Analysis 

The data were analyzed through the 
grounded theory approach in order to 
uncover relevant categories and the re- 
lationships among them. With grounded 
research, we wanted to uncover relevant 
categories and the relationships among 
them, that is, to merge categories in new, 
rather than standard ways (Strauss & 
Corbin, 1998). The initial codes were based 
on the broad questions and topical areas 
guiding the interview, but were expanded 
to include unexpected information that 
emerged from the discussion. 

Initial coding yielded five pages of 
open codes (approximately one page per 
participant), which was further reduced to 
12 axial codes using the paradigm model — a 
tool used to link subcategories to a category 
in a set of relationships (casual conditions, 
phenomenon, context, intervening condi- 
tions, actions, and consequences) and relate 
them in complex ways (Strauss & Corbin, 
1998). Finally, the selective coding yielded 
three categories and three subcategories. 
From the qualitative inquiry, the findings 
are discussed by categories and compared 
and contrasted by theme. 

Results 

We identified three themes that 
emerged out of the data from participants’ 
perceptions as professionals educators that 
may have hindered or facilitated some 
aspect of people of color’s experiences with 
educational testing and measurement in 
academe. The first theme — bias — yielded 
four sub-topics: instruments, profession- 


als, practice, and language. The second 
theme discussed is cultural congruency 
and sensitivity, while the last theme dis- 
cussed is proponents of diversity. 

Bias 

The bias theme is used to describe the 
participants’ perceptions and experiences 
of discrimination and prejudice due to lan- 
guage, people, practice, and the use of cer- 
tain instruments. This theme also includes 
the participants’ personal and professional 
experiences. The first author developed a set 
of guidelines relating to various aspects of 
language, professional bias in assessment, 
administration, interpretation, and practice 
(which include the manifestation of bias 
within the various fields and disciplines re- 
lated to education), and inappropriate abuse 
and misuse of assessment instruments in 
order to merge the data. The subthemes of 
language, people, practice, and instruments 
emerged from these guidelines and were 
subsumed under the bias theme 

Language Bias 

Under the language bias theme, the 
participants’ advocated an awareness of 
how language impacted learning. Speaking 
and understanding a person’s language is 
the key to eliminating some of the language 
bias. The participants defined language 
broadly to include bilingual and non-native 
English speakers, but also the cultural, 
intonation, semantic, or dialectal differ- 
ences, and other language nuances of native 
English-speaking people of color (e.g., Afri- 
can-Americans and Native-Americans). 

This includes matching the language 
and metaphors to those of the person, us- 
ing simple language, communicating at 
the level of that person, and empowering 
him or her with words. It also includes a 
willingness to listen, ask questions, and 
share in their experiences as culturally 
different people. In addition, the partici- 
pants’ advocated for an awareness of how 
language impacted learning. 

Some of the participants believed that 
language was the most pervasive form of 
bias, specifically as it related to students 
of color. For example, in one participant’s 
experiences as an elementary language 
schoolteacher and teacher educator, she 
stated that, “Since I was a language teach- 
er, it’s everywhere.” The participants also 
felt that those language barriers were fur- 
ther compounded by the lack of adequate 
language deficiency assessment tools. Too 
often students of color are unfairly as- 
sessed and discriminated against based on 
the way they speak without instruments 
to tease out culture from deficiency. 


Another participant, a former teacher, 
gives further proof of this. From her ex- 
perience as a teacher and an attorney for 
the State Board of Education, she noticed 
that students of color’s learning and their 
academic performance were negatively 
impacted by not-so-easily measured fac- 
tors such as teacher expectations and 
nonstandard, non-mainstreamed behavior. 
She also noticed that the big issue in these 
students’ academic success relates to the 
role that language plays and “then you 
have the other intelligences, and these 
are not measurable.” Meaning that, of- 
tentimes, the students of color’s potential 
for academic success is evident in other 
measures of intelligences. 

Ultimately, these participants called 
for more researchers, clinicians, and edu- 
cators in assessment who are bilingual, 
multilingual, and culturally diverse and 
from the same ethnic, racial and cultural 
backgrounds of the people they are serv- 
ing. They felt that this was a critical and 
necessary step needed to help transform 
the measurement and assessment field 
to meet the needs of people of color. 
According to one participant, a former 
English teacher and teacher educator, in 
addressing language issues of students of 
color, “One needs to have a sense of how 
language bias impacts behavior.” 

Practice Bias 

The area of practice bias, although 
closely related to professional bias, refers 
more to educational institutions and the 
inequity in the development and imple- 
mentation of their policies and programs. 
In contrast to people bias, practice bias 
is institutional, similar to institutional 
racism. Similarly, practice bias may be 
covert and may appear neutral, but it is 
often detrimental to people of color in its 
core principles, applications, and practices. 
One clear example of practice bias is the 
notion of equality (the same for everyone) 
verses equity for all; meaning, having a 
set of assessment standards and tools that 
are universally applied to all ethnic racial 
groups regardless of the results. 

According to one participant, there 
is an inherent bias to most assessment 
instruments being used in education — 
primarily that assessment is “done by 
the dominant culture and limited by a 
western, Eurocentric paradigm.” Another 
example are schools that have curriculum 
designed for the one-size-fit-all students. 
In short, schools, colleges, and universi- 
ties continue to apply policies that tend 
to benefit mainstream White students. 

From their personal and professional 
experiences, the participants knew that 
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culture plays a major role in how children 
learn and that children of color may need 
diverse curricula. As one participant 
explains, “Teachers have seen the need 
to implement alternative assessment for 
kids that don’t fit the typical kid mold.” 
Further, she states, “Everybody benefits 
from multicultural assessment because 
we are all different and learn differently.” 
Another participant, an attorney, adds 
that, “The discipline of law must interpret 
what a client has written and factor in 
culture.” 

The participants, although victims of 
bias and discrimination in many aspects 
of their personal lives, felt most affected 
by practice bias within their professions. 
For example, one participant, an African- 
American male, recalled a painful child- 
hood memory relating to bias assessment 
procedures, saying, “Personally, I have 
been as greatly affected by multicultural 
assessment issues as well as others, which 
present themselves through my job.” 

Similarly, another participant, a 
Native American school counselor, was 
witness to the adverse effects of bias 
practices in her area of mental health. 
According to her experiences, “Media and 
journal articles on cultural biases involved 
in assessment, measurement, and testing 
have limited opportunities for input from 
individuals from minority groups.” 

On the other extreme, another par- 
ticipant, an African American and former 
school district superintendent, in her 
current position as a higher education 
administrator stated that multicultural 
assessment was not utilized. What she 
found instead was, “A great deal of ste- 
reotyping and assessment of individuals 
impacted by many external factors.” 

Professional Bias 

Professionals bias, according to the 
participants, referred to the biases and 
discrimination perpetuated by the indi- 
viduals within their professions. This en- 
tails the professionals’ lack of awareness, 
knowledge, and skills to work with people 
from diverse backgrounds. This bias in- 
cludes failure of professionals to consider 
or acknowledge (in research, teaching, and 
practice) the many cultures, races, and 
ethnicities that exist, and how these cul- 
tural variances impact their disciplines. 

For example, in her role as lawyer, 
one participant felt that, “Attorneys 
often hold culture against their cultur- 
ally different clients and think they are 
ignorant.” Similarly, another participant, 
an African American, in his experience as 
an elementary teacher educator believes 
that because most test items are written 


by White authors, “Testing item writers 
suffer from bias which impacts the validity 
of the items they create.” 

History, according to another par- 
ticipant, is another discipline that, “Has 
historically accepted Caucasian/European 
race’s history as the only true account.” 
Further, he believes that historians have 
been biased in their assessment, “By giv- 
ing biased points of views or by dismissing 
integral parts of viewpoints that relate to 
other races.” 

All of the participants agree that their 
academic areas are greatly impacted by 
diversity and therefore multicultural as- 
sessment needs to be utilized. Often, the 
issue is not the compilation of data and 
demographics. One participant points out 
that in higher education, “This informa- 
tion and subsequent assessment provide 
us with a perspective of what students 
we serve.” Rather, the issue seems to 
be related to applying those data in an 
ethical, fair, unbiased, nonharmful, and 
multiculturally competent way. 

Unfortunately, the difficulty of this is 
illustrated in one participant’s (the Hispan- 
ic teacher educator) comment that there are 
still, “Lots of teachers that have a hard time 
understanding the need to assess children 
in an eclectic way.” Even more dishearten- 
ing is that, “There are many teachers who 
do not acknowledge or value other people’s 
cultures.” An authentic example, according 
to another participant, is that the “A, B, C 
grading system is still very arbitrary and 
unfair to students of color.” 

Instrument Bias 

For these participants, instrument bias 
was the most prevalent, widespread, and 
discussed form of bias. In addition, from 
their perceptions, instrument bias was the 
most powerful and had the most potential 
for harm to people of color and was the one 
that had the most impact on their personal 
as well as their professional lives. Accord- 
ing to one participant, an observant par- 
ent/grandparent and public school teacher, 
“Subjective testing denies children of color 
enrichment opportunities and the realiza- 
tion of their competence and fosters the 
belief these children can’t learn.” 

According to the participants, many 
of the instruments used for assessment in 
their disciplines are not normed with and 
were found to be unfair to culturally diverse 
populations. As a Native American Indian, 
one participant reflects on her own experi- 
ences as a child. She recalls, “I learned very 
early that standardized tests were biased 
and therefore, I had to separate my per- 
sonal cultural views from what I thought 
the majority answer would be.” 


Another participant, a former second- 
ary English teacher and doctoral student, 
stated: 

Multicultural issues in general have been 
very important. In the area of assessment, 
she felt that students on the secondary 
level were suffering tremendously because 
the tests utilized by the district did not 
make allowances for diversity. In her 
opinion, these tests were the primary de- 
terminants of the child’s placement for the 
next year. If the student faired poorly on 
the English or reading sections of the test 
he or she could be denied entrance into 
gifted and talented classes and college pre- 
paratory classes. Teachers were also given 
the task of determining the placement of 
a given child. The teacher’s referral was 
important; however, they were to keep in 
mind the child’s test scores. If the scores 
did not reach a particular cut off score, 
teachers were instructed not to recom- 
mend them for certain services. 

Another participant, the African 
American former public school teacher 
and administrator, recalls that one of the 
negative effects of biased instruments was, 
“Tracking of my son into lower level classes 
due to his performance on standardized 
tests.” He also witnessed this occurrence 
“with a percentage of my students over the 
course of 15 years of teaching.” 

Overall, the participants believe 
that by understanding that all assess- 
ment instruments are not free from bias, 
professionals can be empowered to work 
more effectively with diverse populations. 
For example, one participant, a mental 
health professional, believes firmly that 
the, “Counseling programs are making 
great strides in training counselors to be 
more culturally aware.” Most urgently, 
these participants call for more studies to 
be conducted to determine the accuracy of 
standardized testing in predicting levels 
of performance of people of color. 

Cultural Congruency 
and Sensitivity 

The participants believed that first, 
culture is not uniquely measurable, there- 
fore, before assessment and testing can be 
effectively employed, the person’s culture 
must be identified and then valued. In the 
emphatic words of one participant, “Culture 
incongruence” is the one single factor that 
can adversely affect the success of students 
of color. Another participant, a retired 
public school principal, observed, “When 
cultural needs are identified and met, the 
student is able to perform more closely 
to their level of ability than when simply 
treated as part of a homogeneous group.” 
As people of color, all of the partici- 
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pants shared their experiences of White 
people asking them to represent their race 
by responding to questions like, “How do 
you feel as an African American about X 
and what is the significance of Y to African 
Americans? It is this assumption that one 
person as a member of a racial/ethic group 
represents the culture of his or her entire 
racial ethnic group that shows an ignorance 
on the part of White people of the massive 
heterogeneity that exists within groups of 
color that pushed one of our participants, 
the higher education administrator, to ad- 
vocate multicultural assessment to be “Used 
to sensitize others to the needs of those in 
a multicultural environment.” 

In fact, the participants believed that 
multicultural assessment should be a pre- 
requisite to activities such as designing cur- 
ricula, creating new programs, and the like. 
Multicultural assessment is an important 
element in determining the program needs 
of constituents. Without this awareness of 
cultural differences, and often because of 
institutional racism and bias, people of color 
have been victims of massive discrimination 
practices. One participant, in his roles as 
teacher and administrator, worked with 
culturally diverse student populations and 
observed that because no provisions were 
made for cultural differences, students of 
color were rarely rewarded for their work 
and achievements. 

Participants have experienced or wit- 
nessed the positive benefit of multicultural 
assessment and the negative effects of not 
taking a multicultural approach when as- 
sessing people of color. One participant, in 
her role as a international student teacher, 
was sensitive to the fact that she was not 
from the American culture, and felt that 
she benefited from multicultural assess- 
ment mainly because the professors she 
encountered were open-minded to a diverse 
student body. 

These participants talked about the 
pain associated with abandoning their 
cultural values in order to become a part 
of mainstream academe. One participant, 
though not visibly a minority, comes from 
a multicultural background — Jewish and 
Native American ancestry. He states that 
he “often finds it necessary to rethink 
answers and responses to minimize my 
cultural background influences.” 

The participants’ conversations about 
multicultural assessment range from the 
more concrete and specific professional 
and personal experiences to the more 
abstract theoretical explanations of the 
critical issues affecting the assessment. To 
begin with, multiculturalism has caused 
a great deal of fear among individuals in 
the educational system. A lot of the fear, 


our participants believe, is because those 
individuals who are frightened truly do not 
understand the essence of the mission of 
multiculturalism. The bottom line is that 
multicultural education, which as a theo- 
retical construct (nontangible, a thought 
process), is all about assessing and meet- 
ing individual needs. Student success is 
what we seek in the educational realm. 

According to one participant, in order 
to ensure the success of students of color, 
“educators must assess and take students 
where they are, help them to use what they 
have, to learn and do what they have to 
do.” Another benefit of multicultural as- 
sessment and related issues, as expressed 
by our participants, is helping people be- 
come more sensitive to other cultures. For 
example, becoming more cognizant of how 
language affects people, in contrast to their 
prior belief that language was universally 
valid when working with diverse culture, 
something that most of them unknowingly 
had taken for granted. 

One participant articulates that 
multicultural assessment, “Is more like 
an awareness or an insight.” Further, 
according to another participant, “It has 
provided me with a better understanding 
of the needs of a multicultural society and 
better planning for programming.” 

The participants also believe that an 
awareness of differences due to cultural 
diversity can allow the practitioner to more 
accurately interpret results generated 
through multicultural assessment and to 
more closely meet the needs of the indi- 
viduals being served. For one participant, 
another benefit of multicultural assessment 
has been the creation of programs and proj- 
ects geared towards cultural diversity. 

Further, according to several of the 
participants, multicultural assessment is an 
invaluable tool in working in a multicultural 
environment when measuring knowledge 
levels as well as determining tolerance levels 
or programming needs for institutions. Ac- 
cording to one participant, “It helps to offset 
environmental constraints.” 

According to the participants, some 
educators feel that the focus on multicul- 
turalism is a fad, here today and gone to- 
morrow. On the contrary, in the opinion of 
our participrants, a real focus on diversity 
training and competencies can assist us in 
ensuring academic success for all people 
and not just a limited few. 

Lastly, other benefits of cross-cultural 
assessment procedures and practices, in 
many cases, are the assurance of equity and 
fairness in our schools for students from 
marginalized backgrounds and the recog- 
nition of the importance of the multiple 
talents and gifts that people of color have 


given to our nation. In fact, the resource 
pool in the academy and the workforce is 
vast when you include people of color, and 
the sooner assessment practices find a way 
to make sure all segments of the popula- 
tion are represented, the greater resources 
this country can expect to have. 

Proponents of Diversity 

Having educators serve as proponents 
of diversity is critical to institutions of 
higher education and assists in leveling 
the playing field for people of color. Several 
researchers, such as Sue and Sue (2003), in 
the field of counseling and psychotherapy 
have for decades advocated increased rep- 
resentation of people of color in academic 
disciplines. Therefore, there is a need for 
all of us to actively campaign for the rep- 
resentation of all groups in every aspect of 
assessment and measurement. To these 
participants of color, being a strong propo- 
nent of diversity, in part, means to advocate 
more representation of people of color. 

Most importantly, being a proponent 
of diversity means that one has adapted a 
willingness to implement a multicultural 
approach within his or her respective disci- 
pline. The participants believed that they, 
like other professionals in the field, are 
strong advocates for diversity programs. 

As an African-American educational 
administrator, one participant concluded: 

Research and practical implications of 
multicultural assessment to the educational 
discipline are not at the level that it should 
be. There are many educators, such as my- 
self, who will be advocates of implementing 
a multicultural approach into the field of 
education. Similarly, we serve a community 
of students who are very diverse and this 
diversity must be addressed. 

It means also to know the important con- 
tribution of professionals who are cultur- 
ally, ethnically, and racially diverse. 

As proponents of diversity, the partici- 
pants shared an urgency and necessity to 
address ethnic and racial diversity within 
their own professional and academic fields. 
For example, one participant stated that, 
“My area of expertise has impacted multi- 
culturalism by creating laws to ensure that 
measures are taken to create more diversity 
in our nation’s companies, universities, and 
government-affiliated organizations.” 

Likewise, another participant acknowl- 
edges that, “An enormous amount of re- 
search is needed in our area in order to find 
different types of assessment that will focus 
on those groups that are underrepresented 
in gifted and talented education programs.” 
Unfortunately, the participants realize that 
too often, in their own disciplines, assess- 
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ment determines who, what, and how re- 
sources are allocated. In public schools, one 
participant discovered that, “If assessment 
means the varying ways we determine 
those students who will receive services, 
multiculturalism has greatly impacted the 
area of gifted and talented education.” 
Therefore, the participants believe 
that those who are proponents of diversity 
seek ways that the field of assessment and 
measurement can objectively address 
diversity issues as well as the needs of un- 
derrepresented groups in a less biased way. 
For example, in one participant’s area, new 
initiatives were developed to address the in- 
crease in diversity, “In my workplace, they 
have had a great impact on the development 
of new programs designed to increase the 
graduate minority enrollment.” 

In some of the participants’ fields, in 
order to determine the applicability to and 
effectiveness on the targeted groups, cer- 
tain diversity initiatives were assessed and 
evaluated. According to one participant, 
“Yearly state mandates must be evaluated 
to assess whether or not the criteria used 
in their assessment met the needs of their 
population.” In another participant’s pro- 
fession, “Data is often compiled to get an 
accurate view of the campus demographics. 
This information and subsequent assess- 
ment provides us with a perspective of 
what students we serve.” 

Unfortunately, not all disciplines 
are as committed to or as successful at 
addressing diversity issues. According to 
one participant, in her field multicultural 
assessment is being more frequently used, 
but is not yet widely used. In her opinion, 
people have attempted to implement other 
methods in order to avoid assessment, “I’ve 
known people to use learning styles in 
place of the assessment because they are 
not proponents of diversity.” 

The bottom line is that participants 
first believe that is it is imperative to 
have researchers, clinicians, and educa- 
tors within all academic areas who are not 
just visibly persons of color, but who are 
grounded and acculturated within their 
own ethnic and racial referent groups, 
rather than in the dominant culture. 

Second, to these participants, as 
people of color, they have discovered that 
being proponents of diversity is personal 
and unavoidable. As an African-American 
attorney and an administrator in a large 
research university, one participant cap- 
tures this sentiment, “In my personal life, 
it has caused me to be more consciously 
aware of others and their surroundings.” 
In other words, to these participants, being 
a proponent of diversity transcends work 
and professionalism; it is survival. 


Discussion 

Trustworthiness of the Design 

In order to assure trustworthiness 
of the data, as researchers, we utilized 
multiple data collection and triangulation 
methods. Data triangulation included data 
sources, such as observations, interviews, 
and available documents. Theory triangu- 
lation was also used to gain multiple per- 
spectives to interpret the data. And lastly, 
we employed methodological triangulation 
that consisted of combining qualitative 
inquiry with quantitative instruments and 
the use of multiple methods, primary and 
secondary data sources. 

The primary sources consisted of 
SOIG interviews, critiques of transcripts 
and audiotape interviews, interactive 
and informal conversational interviews, 
field notes, and researchers’ journals. The 
secondary sources consisted of personal 
accounts (i.e., diaries, journals, personal 
notes) and clinical documents. 

In order to further assure trustwor- 
thiness, we used prolonged engagement, 
persistent engagement, member checking, 
and audit trail. This means that we con- 
tinued to collect data until all the holes in 
the data were filled and all questions had 
been answered (prolonged engagement). 
We constantly looked for inconsistencies 
and pressing anomalies (persistent engage- 
ment). We reviewed data with participants 
to ensure accuracy or check inconsistencies 
(member checks). We discussed the findings 
with fellow students, dissertation commit- 
tee members, qualitative research group, 
and faculty members in order to clarify and 
validate assumptions (peer debriefing). 

We examined all pertinent documents 
that were available to us. We maintained 
an account of all the data collected and the 
inferences made from these data and kept 
accurate, detailed notes of the data col- 
lected from the beginning of my research 
(audit trail). We tried to determine if the 
inferences are warranted or justified and 
flow from the data. We conducted follow-up 
observations and interviews and interac- 
tive interviews. 

Ethical Considerations 

Patton (2002) states that it is impor- 
tant to deal with ethical issues of qualita- 
tive inquiry because: (1) qualitative meth- 
ods are highly personal and interpersonal; 
(2) naturalistic inquiry takes the research- 
er into the real world where people live and 
work; (3) in-depth interviewing opens up 
what is inside people; and (4) qualitative 
inquiry may be more intrusive and involve 
greater reactivity than surveys, tests, and 
other quantitative approaches (p. 407). Ac- 


cording to Patton, there are several ethical 
issues that a qualitative researcher should 
deal with in designing and implementing 
qualitative studies; mainly, reciprocity, 
risk assessment (causing no harm to the 
participants), confidentiality, informed 
consent, and data access and ownership. 

In terms of reciprocity, the benefits for 
the participants in this study included the 
personal and professional satisfaction of 
contributing to research concerning ethnic/ 
racial diverse groups’ experiences of assess- 
ment, measurement, and testing. We believe 
that the patterns and commonalties that 
we uncovered, as well as the research itself, 
was helpful to the participants personally 
and in their professional roles as educators, 
practitioners, researchers, and educators. 

In assessing for risk factors and 
maintaining confidentiality, risks were 
minimal since we kept the participants 
and locations confidential and all taped 
materials as well as interviews, observa- 
tions, and document data in a personal file. 
At the end of study, all video and audio 
taped material was destroyed. All recorded 
and transcribed interview data were kept 
confidential. Information was stored on 
diskettes for necessary updates and only 
we, the researchers, analyzed all data. 

Anonymity was assured by protect- 
ing the identity of the participants, their 
clients, students, instructors, supervisees, 
and institutions, making certain that the 
names and other identifying labels were 
not disclosed. Names and identifying in- 
formation were coded initially, and only 
we, the researchers, had access to the 
data. Participants were asked to choose a 
pseudonym of personal or ethnic signifi- 
cance to them. That pseudonym was used 
throughout the study. 

Next, informed consent was addressed 
via a form. Participants were given a copy 
of the informed consent form to read. It 
included the description of the study, the 
nature and purposes of this study, the 
procedures to be used, and the potential 
risks, as well as the option to withdraw 
at any time. Participants were told that 
participation was voluntary and that they 
were free to refuse to participate in this 
study or to withdraw from this study at 
any time with no negative consequences 
or penalty. 

Closely aligned with informed consent 
is data access and ownership. The partici- 
pants were informed (verbally and on the 
informed consent form) that by signing the 
informed consent form they were giving 
us, the researchers, permission to make 
audio/video tape recordings and proceed- 
ings of interview and test interpretation 
sessions and granting us the right to use 
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the original audio tapes made of them for 
research purposes only. 

They were also apprised that they 
had the following rights: to request that 
video or audio recording be turned off at 
any time; to request erasure of any part 
of a recording at the time of its creation 
or within seven days thereafter; and to 
review the audio tapes. We told them that 
all audiotapes would be destroyed and that 
audiotape materials would be handled in 
accordance with professional standards 
and the code of ethics of the American 
Counseling Association (1995). 

Summary of Results 

The participants in this study, as multi- 
cultural practitioners, witnessed unfairness 
in assessment in their respective disciplines 
and they see a need for fair assessment 
devices. As one administrator stated, 
“Multicultural assessment is an invaluable 
tool in working in a multicultural environ- 
ment.” To summarize, the findings in this 
study uncovered the following themes: (a) 
bias in terms of instruments, professionals, 
practice, and language; (b) cultural congru- 
ency and sensitivity; and (c) proponents 
of diversity as key issues in educational 
assessment and measurement. 

These findings substantiate issues as- 
sociated with the stress process described 
in Sedlacek’s (1994) theoretical framework 
and similar findings in the literature. That 
is, these findings are consistent with di- 
versity issues identified in the theoretical 
framework of Sedlacek’s model. 

First, consistent with the model, there 
remains a need for culturally sensitive 
methods and approaches for including peo- 
ple of color. Second, we continue to employ 
assessment techniques and instruments 
that put people of color at a disadvantage, 
because we have yet to discover a valid 
single instrument or measure for all. 

Next, major efforts need to continue 
in conducting research, and most impor- 
tantly, recruiting researchers of color to 
conduct research that is inclusive of the 
culturally different. Also, professionals 
continue to witness bias in situations of 
incomplete data and lack of data. 

Lastly, there remains a shortage of 
well-trained professionals working in this 
area, and an even greater shortage of 
professionals of color, as is evident in the 
statistics on the small number of teachers, 
professors, and administrators of color 
(NCES, 2000; Turner & Myers, 2000). 

The findings in this study identified 
some key factors in educational and psy- 
chological assessment and measurement, 
such as bias, cultural congruency, and the 


need for institutions and professionals to 
be proponents of diversity. These findings 
also revealed a lack of literature repre- 
senting the perspectives of people of color 
within training, teaching, researching, and 
clinical and practical work, even in cases 
where such work is being undertaken by 
people of color. 

In addition, the findings reflect the 
participants’ views of the existing com- 
monalities and the discipline-specific com- 
petencies in educational and psychological 
testing and gave suggestions on how we 
can create meaningful dialogue on diver- 
sity issues among and across disciplines 
and among colleges and universities. This 
dialogue, according to the participants, 
must begin at home, with professional 
people of color, and move out into the arena 
of educational reform in the areas of as- 
sessment and testing for people of color. 

The participants’ thoughts on needed 
competencies in assessment of people of 
color are consistent with the multicultural 
education and mental health research lit- 
erature on ethical considerations, training 
guidelines, and competencies in relating to 
people from marginalized backgrounds in 
general (Krishnamurthi, 2003; Toporek & 
Reza, 2001; Wall & Walz, 2003). 

Therefore, if multiculturalism is 
to fully strengthen the education field, 
then a challenge to practitioners and 
researchers from all disciplines impacted 
by assessment, measurement, and testing 
must be consistent with Sedlacek’s (1994) 
vision. That is, as professionals, we must 
look beyond the obvious. This includes 
strengthening our ethical standards, and 
scouting for ways to advance diversity 
through assessment. 

As a first step, we must address 
professionals bias, by conducting an in- 
ternal check, a self-examination of our 
own values and practices that too often 
tend to be biased. Next, we must address 
instrument bias to see if we are design- 
ing and administering instruments from 
beginning to end with people of color in 
mind, instead of just as an afterthought 
throwing in diverse groups. 

We must ask ourselves the ethical 
questions, such as, are we discarding 
important data about underrepresented 
groups? And finally, in terms of practice 
bias, are we committed to developing 
policies that encourage those in the fields 
of mental health and education, which 
have an interest and commitment to the 
issues impacting diverse groups, to become 
trained assessors? 

However, if any understanding is to 
develop, we in the field of education must 
include people of color’s voices, perceptions, 


and experiences about cultural bias and 
culturally biased assessment practices and 
their effects on disciplines and students’ cul- 
tural awareness and knowledge of cultural 
issues. It is equally critical that assessors of 
all races be aware of the importance of the 
impact of the cultural self on assessment, 
diagnosis, and intervention, especially as 
it relates to the bias of White professionals 
when assessing people of color (Dana, 2000; 
Suzuki, 2001; Valencia & Suzuki, 2001). 
These are necessary steps for implementing 
cultural congruency in the field of educa- 
tional assessment and measurement, and 
in becoming proponents of diversity. 

It is also our hope that researchers, 
statisticians, counselor educators, and 
practitioners be sufficiently challenged 
by the findings of this study to assess 
their own cultural awareness, abilities, 
skills, and knowledge as well as the group 
under their microscope before attempting 
to assessment people of color. Research- 
ers and test developers must realize that 
some biases, whether bias of instruments, 
people, or practice, are an integral part 
of most fields, and what is needed is a 
conscientious effort to avoid inadvertently 
perpetuating harm. 

Concluding Remarks 

In this study, the participants have 
shared their personal and professional 
experiences of assessment instruments 
and practices with people of color. The 
voices of these participants of color speak 
in unison; that is, assessment has been a 
harmful tool in its application to people 
of marginalized backgrounds, specifically 
people of color. In viewing the plurality of 
our society, the resource pool is vast and 
so are the invaluable gifts and talents 
brought to the table by people of color. 

Because of this vast resource pool of 
people of color, assessment procedures and 
practices should be used in a manner that 
demonstrates and maximize the success of 
these diverse populations in our schools, 
workplaces, and thus in society. Therefore, 
the sooner, assessment practices that are 
fair and unbiased are used with all seg- 
ments of the population, the greater re- 
sources we can expect to have as a nation. 

However, until norms are set with 
the various cultural groups, cross-cultural 
assessment should be approached from 
a well-rounded perspective, one that in- 
cludes input via interviews, observations, 
and self-reports with multiple assessment 
instruments and multiple sources, includ- 
ing the voices of people of color. 
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